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Abstract. In this paper we introduce a notion of F— quadratic stochastic operator. 
For a wide class of such operators we show that each operator of the class has unique fixed 
point. Also we prove that any trajectory of the F-quadratic stochastic operator converges 
to the fixed point exponentially fast. 
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1 Introduction 

Quadratic stochastic operator frequently arise in many models of mathematical genetics 
[1, 6-8], [14], [15]. 

The quadratic stochastic operator (QSO) is a mapping of the simplex 

m 

S'"- 1 = {x = (x u ...,x m ) £ R m : Xi > 0, = 1} (1) 

i=l 

into itself, of the form 

n 

v '■ x 'k = H Pij,kXiXj, (k = 1, ...,m), (2) 
where p^^ are coefficients of heredity and 

m 

Pij,k>0, J2Pij,k = 1 i (i,j,k = l,...,m). (3) 

k=l 

Note that each element x £ S m ~ l is a probability distribution on E = {1, ...,m}. 

The population evolves by starting from an arbitrary state (probability distribution 
on E) x £ S*" 1-1 then passing to the state Vx (in the next "generation"), then to the 
state V 2 x, and so on. 

For a given x^ £ 5" 11 " 1 the trajectory {x^},n = 0,1,2,... of x^ £ S™' 1 under 
action QSO (2) is defined by x^ n+ ^ = V(x^), where n = 0, 1, 2, ... 

One of the main problems in mathematical biology consists in the study of the asymp- 
totical behavior of the trajectories. This problem was fully solved for Volterra QSO (see 
[6], [8], [12]) which is defined by (2), (3) and the additional assumption 



p ijik = 0, if k <£ {i,j}- 



(4) 



The biological treatment of condition (3) is rather clear: the offspring repeats the genotype 
of one of its parents. 



In paper [6] the general form of Volterra QSO V : x = (xi, ...,x m ) G S m 1 — > V(x) = 
x' = (x'u ■■■,x' m ) G S" 1 ' 1 is given: 



where = 2p i j St k — 1 ior i ^ k and a^k = 0. Moreover = — and \a^i\ < 1. 

In papers [6], [8] the theory of QSO (5) was developed using theory of the Lyapunov 
functions and tournaments. But non- Volterra QSOs (i.e. which do not satisfy the condi- 
tion (4)) were not in completely studied. Because there is no any general theory which 
can be applied for investigation of non- Volterra operators. To the best of our knowledge, 
there are few papers devoted to such operators. Now we shall briefly describe the history 
of non- Volterra operators. 

In [5] it was considered the following family of QSO V\ : S 2 — > S* 2 , V\ — (1 — A)Vo + 
AV"i,0 < A < 1, where V (x) = (x\ + 2xix 2) x 2 + 2x 2 x 3 , x\ + 2x\X^) is Volterra operator, 
Vi(x) = (x\ + 2x 2 x 3 , x\ + 2xix 3 , x\ + 2x\X 2 ) is non- Volterra operator. Note that behavior 
of the trajectories of V is very irregular ([16], [17]). 

Also well known the class of bistochastic QSOs which contains Volterra operators and 
non- Volterra operators as well. In [7], [13] the class of such operators is described. 

In [3] a class of kvazi- Volterra operators is introduced. For such operators the condition 
(4) is not satisfied only for very few values of k. 

Papers [9-11] are devoted to study of non-Volterra operators which are generated 
from Volterra operators (5) by a cyclic permutation of coordinates i.e. : x' n ^ = 
x i(l + Dfcli a ik x k),i — 1; ■■■,'m, where 7r is a cyclic permutation on the set of indices E. 

Note that each quadratic operator V can be uniquely defined by a cubic matrix P = 
P(V) = {pij^lj^i with condition (3). Usually (see e.g. [1], [3], [5]-[15], [17], [18]) the 
matrix P is known. In [2], [4] a constructive description of P is given. This construction 
depends on a probability measure \x which is given on a fixed graph G and cardinality of a 
set of cells (configurations) which can be finite or continual. In [2] it was proven that the 
QSO constructed by the construction is Volterra if and only if G is a connected graph. 

In [16] using the construction of QSO for the general finite graph and probability 
measure \x (here [i is product of measures defined on maximal subgraphs of the graph G) 
a class of non-Volterra QSOs is described. It was shown that if // is given by the product of 
the probability measures then corresponding non-Volterra operator can be reduced to N 
number (where iV is the number of maximal connected subgraphs) of Volterra operators 
defined on the maximal connected subgraphs. 

Recently by the authors of this paper a new class of non-Volterra operators is intro- 




i=i 



(5) 
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duced. These operators satisfy 



p ij>k = 0, if ke {i,j}. 



(6) 



Such an operator is called strictly non-Volterra QSO. For arbitrary strictly non-Volterra 
QSO defined on S* 2 we proved that every such operator has unique fixed point. Also it 
was proven that such operators has a cyclic trajectory and almost all trajectories converge 
to the cyclic trajectory. This is quite different behavior from the behavior of Volterra 
operators, since Volterra operator has no cyclic trajectories. 

In this paper we consider an other type of non-Volterra operators. Which we call F— 
quadratic stochastic operators. For a family of such operators we show that each of them 
has unique fixed point and all trajectories tend to this fixed point exponentially fast. Thus 
they are ergodic operators. 



In this paper we extend the set E by adding element "0" i.e. we consider E = {0, 1, m}. 
Fix a set F C E and call this set the set of "females" and the set M = E \ F is called 
the set of "males". The element will play the role of "empty-body". 
Coefficients pij^ of the matrix P we define as follows 



Biological treatment of the coefficients (7) is very clear: a "child" k can be generated 
if its parents are taken from different classes F and M. In general, p^o can be strictly 
positive for % G F and j G M, this corresponds, for example, to the case when "female" % 
with "male" j can not generate a "child" since one of them (or both are) is ill. 

Definition 1. For any fixed F C E, the QSO defined by (2), (3) and (7) is called F— 
quadratic stochastic operator. 

Remarks. 1. Any F— QSO is non- Volterra since p ii:0 = 1 for any % ^ 0. 

2. Note that the class of F— QSOs for a given F does not intersect with the classes of 
non-Volterra QSOs mentioned above (in Introduction). 

3. For m = 1 there is unique F— QSO (independently on F = {1} and F — 0) which 
is constant i.e. V(x) = (1,0) for any x G S 1 . 



In this section we consider m = 2, i.e. E = {0, 1,2}. Take M = {1} and F = {2}. We 
will generalize the result of this section in the next section for m > 3 there F is taken as 



2 Definition of F-QSO 



' 1, if k = 0,i, j e FU {0} or i,jeMU{0}; 
Pij,k=\ 0, if k ^ 0,i,j E FU {0} or i,jeMU{0}; 
>0, Hie F,j G M,\/k. 



(7) 



3 F-QSO for m = 2 
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F = {2,3, ...,m}. Reasons of considering the case m = 2 in a separate section are: (i) in 
case m = 2 the number of "females" is equal to the number of "males"; (ii) In this case 
all calculations can be done explicitly. 

For m — 2, and M = {!}, F = {2} the F— OSO is defined by matrix 



t P00,0 = 1 Poi.O = 1 P02,0 = 1 Pllfi = 1 Pl2,0 
P00,1 = p l,l = J9 2,l = pn,i = Pi2,l 
y P00,2 = Poi,2 = p 2,2 = pn )2 = £12,2 



a P22,0 = 1 \ 

& P22,l = 
C ^22,2 = 



where 



a,b, c > 0, a + 6 + c=l. 
The corresponding F— QSO has the form 



(8) 



V : { 



= + x i + x 2 + 2a;oa;i + 2x0^2 + 2ax\X2 = 1 — 2(1 — a)x\x 2 , 

x[ = 2bxiX 2 , 
j 



(9) 



x' 2 = 2cx\x 2 . 

The fixed point of V is defined as a solution of the equation V(x) = x. 

The following theorem completely describes the behavior of the trajectories of operator 

(9). 

Theorem 1. 1) For any a,b,c with condition (8) the operator (9) has unique fixed 
point (1,0,0). 

2) For any x^ E S 2 the trajectory {x^} tends to the fixed point (1, 0, 0) exponentially 
fast. 

Proof. 1) It is easy to see that the solutions of the equation Vq(x) = x are only 
x — e 1 — (1, 0, 0) and x = x* = (xq, x*, x 2 ) = ( 2fec ~^~ c , ^, ^) if be ^ and only x — e 1 if 
be = 0. Note that x* (£ S 2 . Indeed from < ^ < 1 and < ^ < 1 we get b > \ and c > \. 
Then by (8) we have b — c—\ i.e. x\ = x* 2 = 1 this is impossible since x* Q + x\ + x* 2 = 1. 

2) For x E S 2 denote (p(x) = x\x 2 . We have 



V?(x (n) ) 



' 0, if be = 0, 
{2bc)'\4bcx l x 2 ) 2n , if be ^0. 



(10) 



Now we shall estimate 4bcxiX 2 . We have 

< 4bcxix 2 < 4 • < -. 

4 4 4 

From the second equality of (9) we get 

4 n) = 2£ ¥ >(x (n_1) ). 



(12) 
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By (9)- (12) we have 

lim x^ = lim il"' = 0. 

This completes the proof. 

4 The case m > 2 

In this section we generalize Theorem 1, but now we have not an explicit formula for 

Consider E = {0, 1, m}, M = {1},F = {2,...,m}. Then it is easy to see that 
corresponding F— QSO has the form (cf. with (9)) 

' x' = 1 - 2x 1 E™ 2 (! - a i0 )x i: 

Vx : \ , _ m _ (13) 

X k ~ J27=2 a ikXi, k — 1,2,..., m, 

where 

m 

a ik = Pn,k > 0, i = 2,...,m; fc = 0, 1, m; $^a ifc = l, Vi = 2, ...,m. (14) 

fc=0 

Theorem 2. For any values of aik with (14) the operator (13) has unique fixed point 
(1, 0, 0, 0) fwit/i m zeros). Moreover for any x^ E S m its trajectory {x^} tends to 
the fixed point exponentially fast. 

Proof. For x E S m denote 

m 

<p(x) = xi ^Xi = xi(l - x - x-i). (15) 

Using (13), (14) we get 

m m 
X (n + D = 2x (n) £ ^(n) < ^(n) £ ^(n) = 

where k = 1, 2, m. 

Now we shall estimate (p(x^ n+1 ^): 

^x^)) = xS" +1) (i - - xS n+1) ) = 

(rrt s , m m \ 

2x^ £ a^) (2xS n) £(1 - a*)*? - 2xS n) £ ) . (17) 

i=2 ' ^ i=2 i=2 ' 

Using AM-GM inequality from (17) we get 
V? (^))<4(4" ) ) 2 ( E - 2(1 ~ a ^ ) <(4 n) E^ n) ) ^>0. (18) 



Note that (p(x^) < \. Thus from (18) we obtain 



/ 1 \ 2 n 

¥>(*<»>)<(-) • (19) 
Now it follows from (16) and (19) that 

lim^x^ = 0, for any k — 1, 2, m, 

i.e. 

Jim x (n) = (1,0,... ,0), for any i (0 »6 5 m (20) 

Obviously, (1, 0, 0) is a unique fixed point, since (20) holds for any G S m . This 
completes the proof. 

Remarks. 1. The QSO V satisfies the ergodic theorem if the limit 



n-l 



lim — x 

n— too ri z — ' 
U 3=0 

exists for any x^ £ S m . On the basis of numerical calculations Ulam conjectured [15], 
[17], that the ergodic theorem holds for any QSO. In [18] it was proven that this conjecture 
is false in general. From Theorem 2 follows that the ergodic theorem holds for any F— 
QSO determined by (13). 

2. Assume a matrix P with coefficients (7) is given. Let Ni = iVi(P) = \{ij : p ij:0 = 1}| 
be the number of 1 in the first row of the matrix P, where \A\ denotes the number of 
elements (cardinality) of A. Also denote by Ni = Ni(P) the number of elements of the 
first row of P which < 1. It is easy to see that N ± = l -^(\E\ + 3) + 1 - N x . By (7) one can 
see that 

Wi > i(|F| 2 + |M| 2 + 3|E|) + 1, 
^ < \F\ ■ \M\. 

Obviously, 

i(|F| 2 + |M| 2 + 3|E|) + 1 > |F| • |M|. 

Hence Ni > N±, for any F C E and any P with elements (7). By this property of the 
matrix P one can say that has more priority than other elements of E . Thus we can 
make a 

Conjecture. An analogue of Theorem 2 is true for any F—QSO i.e. for every F C E, 
and P with elements (7). 

3. The F— QSOs with F ^ {2,3, ...,m} will be considered in a separate paper. 
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